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ABSTRACT 

Discrete orthogonal functions are used in adaptive system 
identification algorithms. Adaptive filters are realized by 
forming linear combinations of discrete Legendre, Laguerre, 
and Jacobi polynomials, and backward prediction-error 
polynomials from a lattice structure. The adaptive filter 
weights are updated using the LMS algorithm. FIR and IIR 
bandpass filters are modeled using the adaptive filters, and 


performance comparisons are made. 
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I. INTRODUCTION 


A. ADAPTIVE SYSTEM IDENTIFICATION ALGORITHMS 

Adaptive FIR and IIR digital filters are widely used in 
system identification algorithms. The extensive use of IIR 
adaptive filters has been hindered by several problems: 
(1) Instabilities encountered in their design; (2) Local 
minimums in the mean square error surface; and (3) Slow 
convergence rates of the adaptive filter weights [Ref. 1]. 
Although FIR adaptive filters do not suffer from the problems 
that ail IIR adaptive filters, they typically require much 
larger orders to effectively model a given system. 

Using orthogonal functions in system identification 
algorithms was first employed by Lee in 1932 [Ref. 2). 
Adaptive filters based on orthogonal functions have several 
advantages, namely, they are always stable and have an 
infinite impulse response, making their use ideal for modeling 
systems with long impulse responses. Additionally, the FIR 
adaptive filter weights converge faster than those associated 
with an IIR filter structure due to the unimodal mean square 
emmor Surface. The filter is realized by forming linear 
combinations of discrete orthogonal functions, which are 
weighted to minimize the mean square error of the 


approximation. 


B. THESIS OUTLINE 

A brief description of contents of the remaining chapters 
‘follows. Chapter II introduces the theory of orthogonal 
functions and their use in modeling linear systems. The 
definitions of the orthogonal functions included in this 
research are given. Chapter III develops the actual adaptive 
filter model that utilizes the orthogonal functions for system 
identification. The derivation of the filter weights is 
discussed in detail; significant development of the discrete 
orthogonal functions is’ shown. Chapter IV presents the 
Simulation results of the various filters developed in chapter 
III and comparisons are made between Legendre, Laguerre, 
Jacobi, and backward prediction-error adaptive digital 
filters. Chapter V presents conclusions including limitations 
of the orthogonal polynomial filters and recommendations for 


further research. 


II. ORTHOGONAL FUNCTIONS 


A. THEORY OF ORTHOGONAL FUNCTIONS 
mete W, (Cc) 7 eenGe) pees} Cengibesa Set of real and continuous 
Pumictions. Then the system of functions is said to be 


orthogonal in the range (a,b) if 


b 
: 0 form#n (1) 
f % 42) t)w,(t) dt= i mnOr inn 


feeme kK is called the norm of the corresponding function 
mete 2|- the orthogonal set {w.(t)} 1s considered complete 
if either of the following conditions is true [Ref. 2]: 


(1) There exists no function x(t) with 


x2(t) dt < (2) 


y en, 


such that 


b 
[ x(=)w,(4) dt = 0 oe 0 oe ne (3) 


(2) For any piecewise continuous function h(t) with 


b 
f bets) dt < (4) 


a 


and an € > 0, there exists an integer N and a polynomial 


N 
DC Walt) (5) 
n=0 


such that 
b N 
i Blea > oa) | Cy Ce (6) 
e n=0 


Any stable causal system, h(t), satisfies (4) in the 
interval [0, ©) and can be represented by a complete set of 
orthogonal functions [Ref. 2]. Letting {w,(t)} represent a 
complete set of orthogonal functions in the interval [0,%), 


then 


ene \ CoWAUT eters < Trape (7) 
0 else , 
where the Cijnepresent the expansion coctfilcienece 

Albeit impossible to form an infinite sum of orthogonal 
functions, it 1S practical to form a finite sum of orthogonal 
functions with an accompanying error, €, aS given by (6). It 
is therefore possible to form an approximate synthesis of a 
linear system, h(t), by forming finite linear combinations of 


orthogonal functions: 
N 
Bz) = 1 2) Coe ener 0 (8) 
else 


This, in itself, is not particularly significant, for 


there are other families of functions that are not orthogonal 


that satisfy (8). A Taylor series expansion, for instance, is 
never orthogonal on any interval, but it is often effective 
when approximating functions [Ref. 3}. Orthogonal functions, 
however, have several desirable characteristics that make 
their use uniquely advantageous when synthesizing linear 
systems. 

Whereas (8) is based on a continuous set of orthogonal 
functions, it is also possible to form an approximate 


synthesis of a discrete linear system, h(k), such that 
, N 
Gamer WwW (KKEION 1 2,56. , (9) 
n=0 


where {w.(k)} represents a complete set of discrete orthogonal 


functions, and the expansion coefficients, c are chosen to 


n/ 


minimize the mean square value of the approximation error. 


B. CLASSICAL ORTHOGONAL POLYNOMIALS 

The classical orthogonal polynomials form a subset of 
orthogonal functions. The three classical orthogonal 
polynomial families that are included in this research are the 
Jacobi, Legendre, and Laguerre. Other families such as the 
Chebyshev and Hermite were found to be unsuitable for linear 
system synthesis using the methods described herein. 

The Legendre polynomials, denoted by p(t) [Ref. 4], are 
Orthogonal on the interval [{-1,1], and, in the form of (1), 


their norm is given by 


1 
2 a 10 
: (PomGe | teks re (10) 


The Jacobi polynomials, denoted by Dag (vc) fRef. 4], are also 


orthogonal on the interval [-1,1] and their norm is given by 


1 
{ (1 = peer + ae eee (2) (2 Ons 
=i 


_ Qe io +1) eep) 


(2n+a+B+1) n! P(n+a+B+1) 


(11) 


Note that if a substitution is made into (11) with both a = 0 
and 8 = 0, the result is equivalent to (10). Therefore, the 
Legendre polynomials form a subset of the Jacobi polynomials. 
Given the orthogonality interval of the Legendre and Jacobi 
polynomials, (-1,1]}], it is not possible to make a dilmege 
Substitution of the polynomvake= tivo (7) The desired 
orthogonality interval for synthesizing causal linear systems 
is [0,”); thus, the orthogonality interval of the Jacobi and 
Legendre polynomials must be shifted by means of a change of 
variables. Details of this process are discussed in 
chapter Iie 

The Laguerre polynomials, 1. (t) [Ref. 2], are orthogonal 
in the interval [0,~), making them more readily applied to vee 
synthesis of linear systems than Jacobi and Legendre 


polynomials. Their norm is given by 


fli) Pare. (12) 
0 


C. ORTHOGONALITY OF THE LATTICE PREDICTOR 

Assuming a stationary input of random variables, each 
stage of the lattice predictor is known to produce a sequence 
of uncorrelated random variables in the form of the backward 
Meeerection errors, {b,(k), b,(k), ...} [{Ref. 3]. These 
backward errors are orthogonal in the range [0,) and, 
therefore, well suited for synthesizing discrete linear 


systems of the form 


oS 


ne) = ss eID aCamrOr Onc k <ie (13) 
0 else 


The lattice filter structure is a manifestation of the 
Gram-Schmidt orthogonalization procedure insofar as the 
generation of the backward errors is concerned. The forward 
prediction errors associated with prediction-error filters are 
also produced by each stage of the lattice filter. However, 
their application to linear system synthesis is not germane, 
for the forward errors are correlated and, therefore, not 


@eenogonal (Ref. 3]. 


III. SYSTEM IDENTIFICATION AND MODELING 


A. ORTHOGONAL ADAPTIVE FILTER MODEL 

Consider a system where x(k) denotes an input to both a 
causal linear system, h(k), and an adaptive filter model, h(k) 
as shown in Figure 3.1. Let d(k) be the desired output of the 


system and y(k) be the output of the adaptive filter. 


ee) d(k) 
+ System 
| 
oO e (k) 
sia a 
ki Adaptive 


Filter | y(k) 


/ 
/ ie 


Figure 3.1: System identification configuration 


Following the derivation in [Ref. 1], the output error is 


Given by 


e(k) = d(k) - y(k) 
= d(k) - SO x(i) Blk - i) “F 
From (9), we write 
e(k) = d(k) => x(i) 3 c,W,(K - 4) , (15) 


where {w (k)} represents a complete set of discrete orthogonal 
mettons, and =the c_ are the expansion coefficients. 


Rearranging the summations in (15) yields 
N k 
e(k) = d(k) -2 Ome (2) WaGer i). (16) 
n=O ino 


And therefore, 


ee) “=a (kK) -y eu (Kk) Ge eciK) -cTu(k) , (17) 
where 
Emo Coy Cee Cul) (18) 
u(k) = Race) , Ul, (eke 7 Unicel” ’ (19) 
and 
u,, (k) -¥ Salle et) (20) 


Figure 3.2 depicts the generic orthogonal function model. 
We consider each Q(z) to be a black box that has two outputs 


when excited by an impulse: One is an orthogonal function 


u.(k), and the other 1s a connectiongte the next solace 
For the purposes of this thesis, we limit our investigation to 
Legendre, Jacobi, Laguerre, and backward prediction-error 


functions to model systems. 





Figure 3.2: Generic adaptive filter configuration for 
Oorchogona lL eine rianc. 


We wish to find a set of expansion coefficients to 
minimize the mean square error of (17). Using the GMS 
algorithm, we take e*(k) to be an estimate of the 
instantaneous mean square error [Ref. 6]. To obtain the 
minimum mean square error, we find the corresponding gradient 
estimate by taking the derivatives of e*(k) with respect to 


the expansion coefficients: 


10 


_ 0e*{k) _ 


= - — 21 
75 AG Zrelrantk) °. (21) 


V(k) 





Applying the method of steepest descent, the LMS algorithm 


updates the expansion coefficients using 


e(k+1) = e(k) + p(-V) , (22) 


mimere pi is a constant that regulates the convergence rate. 


Substituting (21) into (22), we obtain the LMS algorithm: 


e(k+1) = e(k) + 2pe(k)u(k) . (23) 


The expansion coefficients of vector ¢c converge in the 


mean when [Ref. 6] 


a 


O< <¢ — 
© Tao P 


(24) 


All simulations in this thesis set uw according to the 
range specified in (24). The expansion coefficients are 
updated after each iteration in accordance with (23). 
Convergence rates for the expansion coefficients vary 


depending on model type and order. 


A. LEGENDRE POLYNOMIALS 
Recall frome chapter Ill that continuous Legendre 
polynomials form a complete set of orthogonal functions in the 


range [-l,1] and are defined as 


su 


1 > : 
[ n't) Py (t) QG= { Drea aa! = i (25) 
= 0 formt#n 


Following the derivation given by Lee [Ref. 2], a change 
of variable is made to transform the orthogonality range for 
the Legendre polynomials from [-1,1] to [0,~), which is the 
desired range to correspond to the causal time axis. Letting 


the first change of variable be 


i> ZY eee (26) 
causes (25) to become 
1 Beale ios form=n 
2 [ pa(2y - 1)p,(2y - 1) dy={ane4 : (27) 
0 0 form#n 


Letting the second change of variable in (27) be 


Vy = eW~ct ; (28) 


where C is any positive real constant, yields 


{ Ce“'n (2Ce"** — ie (2e" — ee 
0 


(29) 
— Gouene= 11 
={2n+t1 
0 form#n 
Now, defining 
(ee) - WAG: e(-Cc/2)t pmi2ie “S 41) (30) 


and substituting into (29) gives 


WZ 


oo si a 
[ vn(t)v,(e) dt = {Bnei Cad ilies (31) 
0 0 form#n 


ermece (31) satisties the definition of orthogonality given by 
Bereeeien Chewseemiva(t)}, a2 Shitved version of the Legendre 


polynomials, iS an orthogonal set defined in the desired range 


[O,). From (7), h(t) can now be represented by the series 
given by 
ae Dec, Va twee sor 0 5 t seo (32) 
n=0 
else , 


Mitere, again, c. are the expansion coefficients chosen to 
fienomaze the mean square error, and {v.(t)} is the orthogonal 
polynomial set based on the shifted Legendre polynomials. 

In order to realize a digital network, it is necessary to 
Generate the shifted discrete Legendre polynomials based on 
the continuous set {v,(t)}. It is convenient to note the 
meese few terms of the Legendre polynomials [Ref. 7}, {p,(t)}: 


JOS | 
ow) 


At) 


(33) 


1 
16 
ce 
2 2 


meeeettuting (33) into (30), the first few terms of {v,(t)} 


are 


Tee) =a Gem. -) © 
Tac) = Gua os Dec) ae te/e)t (34) 
ae meee eanG eo + Ge 26") e (C/2)e 


16 


Taking the Laplace transform of (34) generates the first few 
terms of the shifted Legendre polynomials in the frequency 


domain, which are given by 


Vi(s) =e eas wae} 

ais - Ces (35) 
V,(S) = ¥30 “oats 
V, (s) = (5C (s - C72ec ee 2D) 


(s + C/2) (s + 3C/2) (s + 5C/2) 


From (35), it is apparent that the general expression for 


CS 1s 
_ (s - C/2) (s - 3@/2)-(s —- (225— Fe 2 
Mel Ts, (s + C/2) (s + 3@72)-(6 + Caen oe Ce 
for n, = "Oye, ee ewe me 


Aivu= «/ Zina Coa (37) 

Of the several techniques available for performing an 
analog to digital filter transformation, the matchequae 
transform is best suited for our purposes. This technique 
preserves the ability to express the digital frequency terms, 
{V.(Z2)}, in a closed form as in (36) and, more importamein® 
allows for a filter structure that is easily synthesized. The 
matched Z-transform maps the poles and zeros of {V.(s)} into 


those of {V.(z)} through theme eve ron 


(s +.a) > (eae 2 ae (38) 
where T represents the sampling period of the discrete-time 


filter [Ref. 8}. 
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Record NG, Beur omni uncG an analog to elavepuie ek 


transformation on (36) yields the first three terms of 


{V,(2)}: 


t G 
iia 4 - e V2g-l 
(ay = Meee S wens). (39) 


(1 - ez) (1 = @ 9/2274) 
7 V5C Ge eo/2z7-1) (= e3C/2 7-1) 
Gee 27-1) (1-e73¢/27-1) (1-e759/27-1) 


As noted, the matched Z-transform preserves the ability to 


express the terms of {V.(Z)} in the closed form 


- yA (= eC/2z-1) (1 = @3¢/27-1)...(4 -— | (22-1)C/27-1) (40) 
V,(Z) z iq e~c/2z-1) a = e~3C/2 7-1)... (4 z @~ (2n+1)C/2 7-1) : 


for n = 0, 1, 2, ..., where 


Poa) (One G (41) 
The synthesis of a discrete system using shifted Legendre 
polynomials is accomplished by generating each Legendre 
polynomial using its corresponding transfer function in (40). 
Mecordingly, substituting each Q(z) Shown in Figure 3.3 into 
the filter structure shown in Figure 3.2 provides the 


necessary filter structure to generate each polynomial. 


C. JACOBI POLYNOMIALS 
The Legendre polynomials form a subset of the much larger 
class of Jacobi polynomials. Like the Legendre polynomials, 


the Jacobi polynomials form a complete set of orthogonal 
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Figure 3.3: Module of Legendre polynomial adaptive filter. 


functions in the range [-1,1]} and, therefore, require a 
transformation to shift the orthogonality range to [| 07coe 


The Jacobi polynomials, {p “"(t)}, are defined as 


ki form=n (42) 


al 
mee: 8 _. (a,B) (a, B) : 
J (1 -t)*(1 +t)? p, (t) Ga ebs c forens a 


where 


kK n Qa+P+1 I (n+a+B+1) [U(n+ +1) (43) 


(2n+a+B+1) nm! T(n+a+B+1) 


Letting the first change of variable be 
t=2y -1 (44) 


causes (42) to become 
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(2 - 2y)“(2y)?P joy owe y=. 1.) opm gma) ay 


LO 
Om 


(45) 
-\% ifm=n 
O afmen 
Letting the second change of variable in (45) be 
y=e ct, (46) 
where C is any positive real constant, yields 
z { Geen ge ©) *(2Qeceme p'*-Pl (pe ce _ 7) 
0 (47) 
Xp ees 1) de-- | _—. | | 
Now, defining 
ds 0 ee (gee) er Pie DIP (26 -ct = 9) Pie 
and substituting into (47) gives 
f vate (ey vst (t) ae = | for msm (49) 
where k* is defined as in (43). Since (49) satisfies the 


definition of orthogonality given in (1), the shifted Jacobi 
polynomials, {v,‘“" (t)}, form an orthogonal set of polynomials 
in the range [0,”). From (7) , any causal system, h(t), may 


be represented by 


ili? 


— (aga) ae 
Hao ». CV, Ce ee oraninee E < (50) 
0 


else 


In order to synthesize discrete linear systems, it is 
necessary to generate the shifted discrete Jacobi polynomials. 
Let the derivation of the shifted discrete Jacobi polynomials 
begin by listing the first few terms of the continuous Jacobi 


polynomials: 


jon CG) [=a 


pitB) Ce) =(a41) + = (a+Bh+2) (t-1) 
2 
(a, B) peal! il! (51) 
psi?) (t) = = (+1) (a+2) + = (a+B+3) (a +2) (t-1) 


+ 2 (a+B+3) (a+B+4) (t-1) %) 


Substituting (51) into (48) yields the first few terms of 
iene (ce) js 
el (t) = EXE QB/2 2-C(B+1) t/2 i = 2e-Cty a/2 
ec ale (t) = Vie 28/2 |-c(B+1) €/2 for = 2e~Ct) 4/2 
x [(a+1) + = (+B +2) (27ct - 2)) 


ae Cs 1 Gs 98/2 e-C(B+1) c/2 (iD = 2e@~Ct) a/2 (52) 
x ((S(a+1) (a+2) 


su 


= (a+B+3) ((a+2) (Ze - 2) 
+ = (a+B+3) (a+B+4) (Ze - 2)? 
We desire to obtain {v,‘~(s)}, the frequency domain terms 
of the shifted Jacobi polynomials; however, it is not possible 


to form a general expression for each term of {V.‘%"(s)} 


because the Laplace transform of (52) yields entirely 


Iie 


different results depending on the value of a. Therefore, 

without losing the generality, we make the derivation specific 

to a= 2.0 for the remainder of this development. 
Substituting a = 2.0 into (52) and taking its Laplace 


transform, we obtain the first few terms of {Vv_“(s)}: 


oe - a — + CAB+3) 

vi2-B (5) = ° K, (s - (+1) /6) 
(s + E(B st) | (s + CUP *3) | (s + E(B SS) | 

y2B eg) Peele cee (Abeer es — (b-+66 +5) C?] 
(s+ AB Ah) (s+ CAB +3) | (s+ CABS) | (s+ CUB #7) » 


(53) 
Where the K are constants. 

Unlike the Legendre polynomials, there is no apparent 
closed form expression to represent the terms of ‘Gieokeanaleise))) 
The denominator terms can be put into a closed form 
expression, but not the numerator terms. This is an important 
concern, for it is carried over to the frequency terms of the 
discrete shifted Jacobi polynomials, ee ez))|}. 

Using the matched Z-transform method to perform an 
analog to digital transformation on the first two terms in 


(53) produces the first two terms of {v,“ (z)}: 


je@ 
Vie (z) Me 00 
Geena, 2 eee ae) (54) 
Re (1 eters | 


ee. 2 pee woe (le a5 *) 


where 


IS. 


oAp 2n9}) (55) 


and the K,_ are constants. 

Without a closed form representation of the terms in (54), 
the problem of generating the discrete Jacobi polynomials is 
considerably more demanding than that of the Legendre 
polynomials. Whereas the transfer function needed to generate 
each of the shifted Legendre polynomials is known (see (40)), 
the transfer function needed to generate each of the shifted 
Jacobi polynomials must be explicitly derived. Due to een 
complexity of the expressions involved , it was necessary to 
use a symbolic software program called MACSYMA to generate 
both the terms of {v,“®(t)} and {v“?(s)}. The terms of 
(cena eranby llfel then be found by transformation. 
Unfortunately, only the first 15 terms of {v,‘““(z)} were 
derived with a = 2.0 and a = 4.0 due to the large size of the 


expressions involved. 


D. LAGUERRE POLYNOMIALS 
The Laguerre polynomials, {1,(t)}, form a complete Scrae. 


orthogonal functions in the range [0,”) and are defined by 
f ia(t)1, (eee SES 2) ae (56) 
0 


Laguerre polynomials are defined over the desired 


orthogonality range, [{0,~); thus, we can immediately proceed 
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with the derivation of the discrete Laguerre polynomials that 


are needed to synthesize discrete linear systems. The first 
rew terms of {1 (t)} are: 

Cee V2C 6 °= 

feGeiea= y2C (2CE —- i1)e“* (57) 


PG 2C(2Gtma4Ct + lle , 


where C is any positive real constant. Taking the Laplace 


transform of (57), we have 


= —— 
L,(s) = f2e 3 


iS) i ae (58) 
(Sao) 

Il = (20 ———_ 

> (S) eo: 


Using the matched Z-transform technique to perform an analog 


@enargital transformation on (58) yields 


-— (1 - ee 

E,(z) = y2C ae (59) 
6 = a a 
L,(2) = ze b= 22) 

The closed form general expression for the terms in (59) is 
lanes)" 

L,(Z) = 2e “ r Fas (60) 

; and all 


Notice that all zeros of (59) are located at z=e” , 


poles are located at z=e*. The synthesis of any linear system 


uSing Laguerre polynomials is accomplished by generating each 


Laguerre polynomial using its corresponding transfer function 
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given in (60). Accordingly, substitutingqueach 0 (z) in Fugue 
3.4 into the structure shown in Figure 3.2 provides the 


necessary filter structure to generate the polynomials. 





Figure 3.4: Module of Laguerre polynomial adaptive filter. 


E. LATTICE PREDICTOR 

Let {b,(k), 56,(K), «.--, DBy(K)} denote the firs cage 
backward prediction errors associated with a backward 
prediction error-filter. If x(k) 1S a stationary input of 
random variables to a backward prediction-error filter, it can 
be shown that the backward errors are orthogonal, that is, 


E(b,(k) b,(k)] {ks EO ne (61) 
0 for ns, ys 


where E[{[] is the expectation operator. Following the proof 


given by Haykin (Ref. 5], we write 


Jogi 


b,(k) = \> a,(m- 1) x(k - 1), (62) 
1=0 


esemde )> eo, 1, ...,) Mm, are the Coefficients of a 
eecctection-error filter of Order m. Substituting (62) into 
(61) yields 


St eee oe ome — 2) 36K = Dp) 


mM 


; 
Ms 
Mr: 


E[b,(k) b,(k)] 


J=0 p=0 
m Nn 
ee ee) an (oD) Hk 1) x(k —.p)) 
l=0 p=0 
m nN 
pene Sled mi) — 7), 
J=0 p=0 
(63) 
mmemest (p-1) denotes the correlation function. The normal 


equations for a backward prediction-error filter are given by 


(Ref. 5) 
n 2 
a ees (Pp -) = | eee (64) 
p=0 . 


Substituting (64) into (65), we find 


E([b,(k) b,(k)] _ | mor nm =o (65) 
CmresOmen +... 


A lattice predictor structure is commonly used to generate 
the backward errors. The lattice structure shown in Figure 
3.5 utilizes the backward errors in an adaptive filter. Let 
Miemccanster function needed to generate each {b,(k)} be 


denoted by 


25 8; 


A,(z) =—= (66) 





By comparing Figure 3.5 to Figure 3.2 we note that A (2) Jem 
a definite relationship tomon@z es The exact relationship 


could be found by evaluating each A,(z) using the signal flow 


graph in Figure 3.5. Furthermore, it is apparent that 
u,(k) = b (k), and, thus, the backward prediction-errors could 
be said to form a family of orthogonal polynomials. The 


synthesis of a linear system is accomplished by forming linear 


combinations of the backward prediction-error polynomials. 





+) y (k) 


Figure 3.5: Lattice predictor adaptive filter. 
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IV. SIMULATION RESULTS 


A. FIR BANDPASS FILTER SIMULATIONS 

For the purpose of evaluating the FIR system modeling 
performance of the orthogonal polynomials, two bandpass FIR 
filters were chosen as the systems to be identified. The FIR 
filters were designed for filter orders of 22 and 71, with 
cutoff frequencies of 0.1 and 0.2 (fraction of sampling 
frequency). Each filter was excited by a zero-mean Gaussian 
white noise sequence with unit variance. The desired output 
sequence was compared against the output of the orthogonal 
network, and the error was used to update the expansion 
coefficients. 

Figure 4.1 shows the impulse and frequency response plots 
Sf an 18" order Legendre adaptive digital filter (ADF) with 
C = 0.11 when used to model a 22™ order FIR system. Notice 
that the Legendre filter has an infinite impulse response that 
allows smaller order Legendre filters to model larger order 
FIR systems. In this case an 18" order model is used for a 
22™ system, which is roughly an 18% savings in terms of the 
filter order. Figure 4.2 shows a 52™ order Legendre ADF model 
with C = 0.075 used to model a 71** order FIR system, which is 


approximately a 27% savings in terms of the filter order. 
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Figure 4.1: Impulse and frequency response of an 18 order 
Legendre ADF used to model a 22™ order FIR filter. 
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Figure 4.2: Impulse and frequency response of a 52™ order 
Legendre ADF used to model a 71%* order FIR filter. 
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The convergence of the first six expansion coefficients 
for the 18° order Legendre ADF and the resulting filter output 
error are shown in Figure 4.3. Notice that all coefficients 
converge by the 200% sample, which implies we need an input 
sequence that has approximately 10 times more samples than the 


order of the system to be modeled. 


(a) Convergence of Legendre ADF Coefficients 
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Figure 4.3: (a) Convergence of first six expansion 


coefficients and (b) Output error for an 18% order Legendre 
ADF used to model the 22™ order FIR system. 


The performance results when an 18 order Laguerre ADF 
with C = 0.98 is used to model the 22™ order FIR system is 
shown in Figure 4.4. The fact that the results are comparable 
to the Legendre ADF is not surprising, for the transfer 
functions needed to generate both sets of polynomials have the 


Same number of poles and zeros (see (40) and (60)). Likewise, 


oY 


Figure 4.5 shows the result of a 52™ order model with C = 0.98 


used to model the 71** order FIR system. 
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Figure 4.4: Impulse and frequency response of an 18° order 
Laguerre ADF used to model a 22™ order FIR filter. 


We expect an improvement in performance when using the 
Jacobi ADF, for the transfer function needed to generate each 
Jacobi polynomial has more poles than that needed to generate 
the Legendre and Laguerre polynomials. Exactly how many more 
poles are realized depends on the value of a. In the case 
where a = 4.0, two more poles are realized in each transfer 
function that generates the corresponding Jacobi polynomial. 
Figure 4.6 shows the results of a 15% order Jacobi simulation 
with {C, a, B} = {0.002, 4, 1000} when used to model the 22" 


order FIR system. 
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Impulse Response: Desired Versus Laguerre ADF 
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Figure 4.5: Impulse and frequency response of an 52™ order 
Laguerre ADF used to model a 71** order FIR filter. 
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Figure 4.6: Impulse and frequency response of a 15‘ order 
Jacobi ADF used to model a 22" order FIR filter. 


OSS. 


Note that the frequency response of the Jacobi model is 
Significantly better in the lower end of the spectrum than in 
the higher end. This can be attributed to the fact that the 
frequency response of each Jacobi polynomial has lowpass 
characteristics; therefore, it is not surprising that a linear 
combination of Jacobi polynomials would perform better when 
modeling frequencies in the lower end of the frequen, 
spectrum. The same is true for both the Legendre and Laguerre 
polynomials. The 71%* order FIR system was not modeled using 
the Jacobi polynomials due to the difficulties encountered in 
determining the transfer functions of the higher order Jacobi 
polynomials as discussed in part C of chapter III. 

Unlike the Legendre, Laguerre, and Jacobi filters, the 
lattice filter structure has a finite impulse response. The 
15% order Lattice model produces comparable results to that 
of the classical orthogonal polynomial models when used to 
model the 22™ order FIR system (see Figure 4.7). Although the 
lattice filter has a finite impulse response, Figure 4.8 shows 
that a 52™ order lattice filter is able to effectively model 


a 71%* order FIR system. 
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Impulse Response: Desired Versus Lattice ADF 
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Figure 4.7: Impulse and Frequency response of a 15 order 
lattice ADF used to model a 22™ order FIR filter. 
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Figure 4.8: Impulse and frequency response of a 52™ order 
maetice ADF used to model a 71** order FIR filter. 
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B. IIR BANDPASS FILTER SIMULATIONS 

As with the FIR filters, two Butterworth IIR bandpass 
’'filters were designed to evaluate the IIR modeling performance 
of the orthogonal ADFs. The IIR filters were designed for 
filter orders of 7 and 31, with cutoff frequencies of 0.1 and 
0.2. Since an N" order IIR filter has 2N coefficients, "ome 
aim is to use orthogonal function adaptive models with 
approximately 2N coefficients. The results herein show the 
lowest order ADF models that demonstrated satisfactory 
performance. 

Figure 4.9 shows a 15° order Legendre ADF with C = 0.075 
used to model the 7% order Butterworth IIR filter. Notice 
that the Legendre ADF does not model the low order IIR syspem 
as well as the low order FIR system as shown in Figure 4.1. 
The IIR filters are difficult to model because the structure 
of the orthogonal adaptive filters more closely resembles a 
FIR filter (see Figure 3.2). 

Figure 4.10 shows a 65° order Legendre ADF with C = 0.055 
used to model the 31% order IIR filter. Notice that the 
impulse response of the IIR filter is still significant beyond 
140 samples, but the impulse response of the ADF does a poor 
JOD Of sdupiieGat ing sane 

As in the FIR case, the Laguerre ADF performance is 
similar to that of the Legendre ADF. Figure 4.11 shows a 15" 
order Laguerre ADF with C = 0.98 modeling a 7 order IIR 


filter. There is marked increase in performance when the 
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Figure 4.9: Impulse and frequency response of a 15‘ order 
Legendre ADF used to model a 7 order IIR filter. 


Impulse Response: Desired Versus Legendre ADF 


0.2 


0.1 


Amplitude 





0 20 40 60 80 100 120 140 160 
Sample 
Frequency Response: Desired Versus Legendre ADF 


—~eee — Legendre ADF 


te re ema ee 


Magnitude (dB) 





0 0.05 0.1 0.15 02 0.25 0.3 0.35 0.4 0.45 0.5 
Fraction of Sampling Frequency 


Figure 4.10: Impulse and frequency response of a 65‘ order 
Legendre ADF used to model a 31** order IIR filter. 
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order of the system being identified 1s increased. 
Figure 4.12 shows that the 31°* order IIR system can be modeled 
with a 65" order ADF. The Laguerre ADF has better performance 
characteristics than the Legendre ADF (see Figure 4.10) in 


both the passband and the stopband. 


Impulse Response: Desired Versus Laguerre ADF” 


Laguerre ADF 


Amplitude 





O 5 10 15 20 2 30 3 40 45 J0e 
Sample _ 
Frequency Response: Desired Versus Laguerre ADF 


Mee 
== 
== 
7 
- 
- 
7. 
“= 
- 
ar se. ees 
ee EE SS Oe cae 
= 
yan 
"eee 


Magnitude (dB) 
SS 
S 


0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 


- Fraction of Sampling Frequency 


Figure 4.11: Impulse and frequency response of a 15‘ order 
Laguerre ADF used to model a 7" order IIR filter. 


A 15% order Jacobi adaptive filter with parameters 
{C,a,B} = {0.0015, 4.0, 925.0} was used to model the 7* order 
IIR filter, and the plots of the model's impulse and frequency 
response are shown in Figure 4.13. It appears that the two 
additional poles in the Jacobi transfer functions do not 
significantly increase low order modeling performance when 
compared to the Legendre and Laguerre polynomials. However, 


there is a possibility that other parameter sets, {C, a, B}, 
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Figure 4.12: Impulse and frequency response of Boe wordes 
Laguerre ADF used to model a 31** order IIR filter. 
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Figure 4.13: Impulse and frequency response of a 15° order 
Jacobi ADF used to model a 7 order IIR filter. 
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do exist that would produce better results. 

The 15° order lattice ADF simulation of the 7° order IIR 
filter is shown in Figure 4.14. As with the FIR case, the 
lattice filter performs better when modeling smaller order 
systems. Notice the poor performance of the 65* order lattice 
ADF when modeling the 31%* order IIR filter as shown in 


Figure 4.15. The reason the lattice filter performs worse 
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Figure 4.14: Impulse and frequency response of a 15* order 
lattice ADF used to model a 7" order IIR filter. 


than the classical orthogonal polynomial filters is that it 
has a finite impulse response, which restricts it ability to 


model higher order IIR systems. 
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Figure 4.15: Impulse and frequency response of a 65‘ order 
lattice ADF used to model a 31°%* order IIR filter. 


37 


V. CONCLUSIONS 


There are several characteristics of orthogonal filter 
models that make their use attractive. The classical 
orthogonal function filters are particularly adept at modeling 
systems with long impulse responses. FIR systems with large 
Orders (say, greater than 70) can generally be modeled with 
25-30% fewer coefficients using the orthogonal ADFs. Large 
order IIR systems can commonly be modeled with the same number 
of coefficients that are in the IIR system. The research in 
this thesis has only evaluated the performance of the 
orthogonal ADF models when used to identify bandpass FIR and 
IIR filters. It is quite possible that systems with strictly 
lowpass or highpass characteristics could be modeled with 
varying degrees of success. Although the orthogonal function 
filter models have shown considerable promise, there are 
several limitations that must be addressed; recommendations 


for future research are also presented. 


A. LIMITATIONS OF ORTHOGONAL FILTER MODEL 

Previous research has shown that the convergence rate for 
the LMS expansion coefficients is increased when using 
orthogonal functions [Ref. 1]. Even so, the length of the 
input sequence must be increased when the desired filter order 


is increased in order to allow the expansion coefficients 


38 


sufficient time to converge. Typically, the input sequence 
must have a length that is 10 to 15 times greater than the 
desired model order. This fact places limitations on the 
orthogonal function models, for large order models require 
long input sequences. 

The selection of the positive real constant, C, will 
Significantly influence the performance of the Legendre, 
Laguerre, and Jacobi adaptive filters. Pine nernene cle 
Jacobi polynomials have two additional parameters, a and BB, 
that must be chosen for any given simulation. There is 
currently no known algorithm for optimizing the selection of 
these parameters. Therefore, evaluating the performance of 
the orthogonal function filters is largely a matter of trial 
ame error. 

The theory for the classical orthogonal function filters 
was derived in the continuous time and frequency domains. The 
matched Z-transform technique was used to map the poles and 
zeros of the orthogonal filters from the s-domain to the z- 
domain. Unfortunately, the matched z-transform technique was 
found to introduce errors concerning the orthogonality of the 
filter output sequences. Other analog to digital 
transformations appear no more attractive, for their use would 
eliminate the ability to express the filter transfer functions 


in a closed form. 


Se, 


B. RECOMMENDATIONS FOR FURTHER RESEARCH 

An algorithm to determine the selection of the positive 
real constant, C, is needed to reduce the trail and error 
nature of the classical orthogonal filter models. Further 
exploration of the Jacobi polynomials is bound to yield 
improved results, for little is known concerning the effect of 
altering a and $8. The application of orthogonal filter models 
to a broad range of systems should be explored. Because the 
classical orthogonal polynomials are lowpass in nature, their 


application may be limited. 
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